Appearance Based Recognition Methodology for Recognising Fingerspelling Alphabets
نویسندگان
چکیده
In this paper, a study on the suitability of an appearance based model, specifically PCA based model, for the purpose of recognising fingerspel-ling (sign language) alphabets is made. Its recognition performance on a large and varied real time dataset is analysed. In order to enhance the performance of a PCA based model, we suggest to incorporate a sort of pre-processing operation both during training and recognition. An exhaustive experiment conducted on a large number of finger-spelling alphabet images taken from 20 different individuals in real environment has revealed that the suggested pre-processing has a drastic impact in improving the performance of a conventional PCA based model.
منابع مشابه
Recognition of Isolated Fingerspelling Gestures Using Depth Edges
Although steady progress has been made on developing vision-based gesture recognition systems, state-of-the-art approaches are still limited to discriminate hand configurations with high amounts of finger occlusions, a common scenario in most fingerspelling alphabets. In this article, we propose a novel method for recognition of isolated fingerspelling gestures based on depth edge features. Our...
متن کاملRecognition of Isolated fingerspelling Gesturs Using Depth Edges
Although steady progress has been made on developing vision-based gesture recognition systems, state-of-the-art approaches are still limited to discriminate hand configurations with high amounts of finger occlusions, a common scenario in most fingerspelling alphabets. In this article, we propose a novel method for recognition of isolated fingerspelling gestures based on depth edge features. Our...
متن کاملUsing N-Gram Analytics to Improve Automatic Fingerspelling Generation
Fingerspelling recognition is one of the last skills acquired, due to the complex nature of fingerspelling and a lack of display technology that is sufficiently natural for recognition practice. This paper describes a corpus-based study utilizing an n-gram extension to ELAN to gain a deeper understanding of deletion and coarticulation in fingerspelling. The analysis shows that coarticulation an...
متن کاملMulti-lingual Fingerspelling Recognition in a Kiosk for the Handicapped
This paper presents the design and evaluation of a multi-lingual fingerspelling recognition module that is designed for an information terminal. Through the use of multimodal input and output methods, the information terminal acts as a communication medium between deaf and blind people. The system converts fingerspelled words to speech and vice versa using fingerspelling recognition, fingerspel...
متن کاملVideo-based Recognition of Fingerspelling in Real-Time
This paper presents a visual prototype for the recognition of 31 different letters and 7 additional handshapes used in German sign language. Fingerspelling is used in sign languages to spell names and words. A letter is defined by one handshape, hand orientation and partly motion within the German fingeralphabet. Using the presented prototype a signer performs fingerspelling in front of a singl...
متن کامل